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Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b)! 

Status 

1)^ Responsive to communication(s) filed on 30 August 2006 . 
2a)M This action is FINAL. 2b)D This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) E3 Claim(s) 1-11 and 13-69 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) I3 Claim(s) 1-11, 13-69 is/are rejected. 

7) Q Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)Q accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 !)□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-1 52. 

Priority under 35 U.S.C. § 1 1 9 

12)D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (0. 
a)DAII b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 

1 ) This is a Final rejection in response to amendments/remarks filed on 8/30/06. 

2) Claims 1-69 are pending. 

3) Effective filing date is 3/30/2004. 

4) Assignee is Ricoh. 

Claim Rejections - 35 USC § 102 

5) The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(a) the invention was known or used by others in this country, or patented or described in a printed 
publication in this or a foreign country, before the invention thereof by the applicant for a patent. 

5-1) Claims 1-11, 13-69 are rejected under 35 U.S.C. 102(a) as being anticipated 

by Copperman et al (US 6665490, issued Dec 16, 2003). 

Regarding amended independent claims 1, 21, 34, 44, 51, 61, 68 and 69, 

Copperman teaches receiving an electronic presentation of a document with 
presentation material, extracting a feature from the electronic presentation of the 
document, the feature corresponding to a portion of the presentation material, 
comparing the feature to the recorded information to determine information in the 
recorded information corresponding to the feature, the recorded information including 
information recorded during a presentation of the presentation material, whereby a 
portion of the recorded information corresponds to a feature portion of the presentation; 
determining additional information relating to the information in the recorded information 
corresponding to the feature extracted from the electronic representation, creating a 
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composite electronic presentation of the document includes the determined additional 
information and storing the composite electronic representation for access by a user of 
the computer system. For example, Copperman discloses obtaining and using data 
associating annotating activities with portions of recordings as a table in which 
annotation identifiers are paired with timestamps (Abstract section - 1 st line). The 
examiner equates the disclosed stored associations in the table as equivalent to the 
claimed storage of composite representation. Copperman discloses a system for taking 
notes on paper during a recording and for using manual activity on paper as an index to 
control playback of the recording, where the user takes notes on paper, then 
subsequently scanned with an identifying feature of the note can be computed from the 
input image and the feature can be stored in a table with the timestamp of the recording. 
The identifying feature can be computed and matched against the set of stored features 
and the timestamp associated with the matching feature can be used to play back the 
associated portion of the recording, allowing handwritten notes on standard paper to 
index and control playback of recordings (col 3, lines 10-32; col 13, lines 10-15). 
Regarding claims 2, 22, 35, 45, 52 and 62, Copperman teaches determining 
associating information for the recorded information that corresponds to the extracted 
feature. Copperman discloses a set of shape feature extracted from the scanned image 
associated with a timestamp, which is used to compare the stored image (col 10, line 65 
-col 1, line 8). 

Regarding claims 3, 23, 46 and 63, Copperman teaches association of time and 
source information (col 3, lines 15-22). 
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Regarding claims 4, 36 and 53, Copperman teaches associating the association 
information with the determined additional information in the composite electronic 
representation. For example, using the annotation ID and timestamp, the system can 
playback/display recordings, images, etc., indexed with the annotation ID for that portion 
of the notes (col 30-45). The examiner interprets the timestamp information as 
additional information that is used to access the recordings jn addition to the annotation 
ID (col 13, lines 10-15). 

Regarding claims 5, 24, 37, 47, 54 and 64, Copperman teaches receiving a selection 
to the determined additional information in the composite electronic representation and 
using the association information for the additional information to access the recorded 
information. For example, using the annotation ID, the system can playback/display 
recordings, images, etc., indexed with the annotation ID for that portion of the notes (col 
30-45). 

The examiner reasonable interprets the timestamp information as additional information 
that is used to access the recordings in addition to the annotation ID (col 13, lines 10- 
15). 

Regarding claims 6, 25, 38 and 55, Copperman teaches accessing the recorded 
information using the determined additional information. For example, the examiner 
reasonable interprets the timestamp information as additional information that is used to 
access the recordings in addition to the annotation ID (col 13, lines 10-15). 
Regarding claims 7 and 26, Copperman teaches displaying the accessed recorded 
information (col 13, lines 30-35). 
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Regarding claims 8 and 27, Copperman teaches playing the accessed information (col 
13, lines 30-35). 

Regarding claims 9, 29, 39, 49, 56 and 66, Copperman teaches performing storing the 
composite electronic representation. For example, The composite representations 
includes stored images and recordings indexed by the annotation ID, where using the 
stored annotation ID, playback of the notes and recordings can be displayed (col 13, 
lines 10-45). 

Regarding claims 10, 28, 40, 48, 57 and 65, Copperman teaches determined 
metadata associated with composite. For example, timestamp and annotation ID are 
metadata (col 13, lines 40-45). 

Regarding claim 11, 41 and 58, Copperman teaches notes taken by the user (col 10, 
lines 53-60). 

Regarding claims 13, Copperman teaches determining a document using the 
extracted feature (col 3, lines 10-20). 

Regarding claims 14, Copperman teaches determining a portion of the document that 
includes the information corresponding to the feature (col 13, lines 10-50). 
Regarding claims 15, 31, 42, 50 and 59, Copperman teaches an identifier to a location 
in the recorded info corresponding to the feature determined using the identifier (col 13, 
lines 10-15). 

Regarding claims 16 and 32, Copperman teaches barcode information as identifier 
(col12, line 47). 
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Regarding claim 17, Copperman teaches receiving a scan of a paper document (col 3, 
lines 10-15). 

Regarding claims 18, Copperman teaches determining an electronic image of the 
paper document (col 13, lines 10-21). 

Regarding claims 19 and 33, Copperman teaches receiving the electronic 
representation in response to an input from a user indicating the composite should be 
created (col 13, lines 30-45). 

Regarding claims 20, 30, 43, 60 and 67, Copperman teaches a paper document (col 
13, lines 10-21). 

Response to Arguments 

Applicants arguments with respect to claim 1-1 1 and 13-69 have been 
considered but are moot in view of the new ground(s) of rejection. Applicant's 
amendment necessitated the new ground(s) of rejection under the Copperman 
reference presented in this Office action (see detailed rejections above). 

Conclusion 

Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
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mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Gautam Sain whose telephone number is 571-272- 
4096. The examiner can normally be reached on M-F 9-5 EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather Herndon can be reached on 571-272-4136. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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Heather R. Herndon 
Supervisory Patent Examiner 
Technology Center 2100 



